Artificial intelligence-based pathology as a biomarker of sensitivity to atezolizumab-bevacizumab in patients with hepatocellular carcinoma: a multicentre retrospective study.

BACKGROUND: Clinical benefits of atezolizumab plus bevacizumab (atezolizumab-bevacizumab) are observed only in a subset of patients with hepatocellular carcinoma and the development of biomarkers is needed to improve therapeutic strategies. The atezolizumab-bevacizumab response signature (ABRS), assessed by molecular biology profiling techniques, has been shown to be associated with progression-free survival after treatment initiation. The primary objective of our study was to develop an artificial intelligence (AI) model able to estimate ABRS expression directly from histological slides, and to evaluate if model predictions were associated with progression-free survival. METHODS: In this multicentre retrospective study, we developed a model (ABRS-prediction; ABRS-P), which was derived from the previously published clustering-constrained attention multiple instance learning (or CLAM) pipeline. We trained the model fit for regression analysis using a multicentre dataset from The Cancer Genome Atlas (patients treated by surgical resection, n=336). The ABRS-P model was externally validated on two independent series of samples from patients with hepatocellular carcinoma (a surgical resection series, n=225; and a biopsy series, n=157). The predictive value of the model was further tested in a series of biopsy samples from a multicentre cohort of patients with hepatocellular carcinoma treated with atezolizumab-bevacizumab (n=122). All samples in the study were from adults (aged ≥18 years). The validation sets were sampled between Jan 1, 2008, to Jan 1, 2023. For the multicentre validation set, the primary objective was to assess the association of high versus low ABRS-P values, defined relative to cross-validation median split thresholds in the first biopsy series, with progression-free survival after treatment initiation. Finally, we performed spatial transcriptomics and matched prediction heatmaps with in situ expression profiles. FINDINGS: Of the 840 patients sampled, 641 (76%) were male and 199 (24%) were female. Across the development and validation datasets, hepatocellular carcinoma risk factors included alcohol intake, hepatitis B and C virus infections, and non-alcoholic steatohepatitis. Using cross-validation in the development series, the mean Pearson's correlation between ABRS-P values and ABRS score (mean expression of ABRS genes) was r=0·62 (SD 0·09; mean p<0·0001, SD<0·0001). The ABRS-P generalised well on the external validation series (surgical resection series, r=0·60 [95% CI 0·51-0·68], p<0·0001; biopsy series, r=0·53 [0·40-0·63], p<0·0001). In the 122 patients treated with atezolizumab-bevacizumab, those with ABRS-P-high tumours (n=74) showed significantly longer median progression-free survival than those with ABRS-P-low tumours (n=48) after treatment initiation (12 months [95% CI 7-not reached] vs 7 months [4-9]; p=0·014). Spatial transcriptomics showed significantly higher ABRS score, along with upregulation of various other immune effectors, in tumour areas with high ABRS-P values versus areas with low ABRS-P values. INTERPRETATION: Our study indicates that AI applied on hepatocellular carcinoma digital slides is able to serve as a biomarker for progression-free survival in patients treated with atezolizumab-bevacizumab. This approach could be used in the development of inexpensive and fast biomarkers for targeted therapies. The combination of AI heatmaps with spatial transcriptomics provides insight on the molecular features associated with predictions. This methodology could be applied to other cancers or diseases and improve understanding of the biological mechanisms that drive responses to treatments. FUNDING: Institut National du Cancer, Fondation ARC, China Scholarship Council, Ligue Contre le Cancer du Val de Marne, Fondation de l'Avenir, Ipsen, and Fondation Bristol Myers Squibb Pour la Recherche en Immuno-Oncologie.

Artificial intelligence predicts immune and inflammatory gene signatures directly from hepatocellular carcinoma histology.

BACKGROUND & AIMS: Patients with hepatocellular carcinoma (HCC) displaying overexpression of immune gene signatures are likely to be more sensitive to immunotherapy, however, the use of such signatures in clinical settings remains challenging. We thus aimed, using artificial intelligence (AI) on whole-slide digital histological images, to develop models able to predict the activation of 6 immune gene signatures. METHODS: AI models were trained and validated in 2 different series of patients with HCC treated by surgical resection. Gene expression was investigated using RNA sequencing or NanoString technology. Three deep learning approaches were investigated: patch-based, classic MIL and CLAM. Pathological reviewing of the most predictive tissue areas was performed for all gene signatures. RESULTS: The CLAM model showed the best overall performance in the discovery series. Its best-fold areas under the receiver operating characteristic curves (AUCs) for the prediction of tumors with upregulation of the immune gene signatures ranged from 0.78 to 0.91. The different models generalized well in the validation dataset with AUCs ranging from 0.81 to 0.92. Pathological analysis of highly predictive tissue areas showed enrichment in lymphocytes, plasma cells, and neutrophils. CONCLUSION: We have developed and validated AI-based pathology models able to predict the activation of several immune and inflammatory gene signatures. Our approach also provides insights into the morphological features that impact the model predictions. This proof-of-concept study shows that AI-based pathology could represent a novel type of biomarker that will ease the translation of our biological knowledge of HCC into clinical practice. LAY SUMMARY: Immune and inflammatory gene signatures may be associated with increased sensitivity to immunotherapy in patients with advanced hepatocellular carcinoma. In the present study, the use of artificial intelligence-based pathology enabled us to predict the activation of these signatures directly from histology.

[The first data challenge of the french society of pathology: An international competition in 2020, a research tool in A.I. for the future?] / Le premier data challenge organisé par la Société Française de Pathologie : une compétition internationale en 2020, un outil de recherche en intelligence artificielle pour l'avenir ?

The french society of pathology (SFP) organized in 2020 its first data challenge with the help of Health Data Hub (HDH). The organisation of this event first consisted in recruiting almost 5000 slides of uterus cervical biopsies obtained in 20 pathology centers. After having made sure that patients did not refuse to include their slides in the project, the slides were anonymised, digitized and annotated by expert pathologists, and were finally uploaded on a data challenge platform for competitors all around the world. Competitors teams had to develop algorithms that could distinguish among four diagnostic classes in epithelial lesions of uterine cervix. Among many submissions by competitors, the best algorithms obtained an overall score close to 95%. The best 3 teams shared 25k€ prizes during a special session organised during the national congress of the SFP. The final part of the competition lasted only 6 weeks and the goal of SFP and HDH is now to allow for the collection to be published in open access. This final step will allow data scientists and pathologists to further develop artificial intelligence algorithms in this medical area.

Can AI predict epithelial lesion categories via automated analysis of cervical biopsies: The TissueNet challenge?

The French Society of Pathology (SFP) organized its first data challenge in 2020 with the help of the Health Data Hub (HDH). The organization of this event first consisted of recruiting nearly 5000 cervical biopsy slides obtained from 20 pathology centers. After ensuring that patients did not refuse to include their slides in the project, the slides were anonymized, digitized, and annotated by expert pathologists, and finally uploaded to a data challenge platform for competitors from around the world. Competing teams had to develop algorithms that could distinguish 4 diagnostic classes in cervical epithelial lesions. Among the many submissions from competitors, the best algorithms achieved an overall score close to 95%. The final part of the competition lasted only 6 weeks, and the goal of SFP and HDH is now to allow for the collection to be published in open access for the scientific community. In this report, we have performed a "post-competition analysis" of the results. We first described the algorithmic pipelines of 3 top competitors. We then analyzed several difficult cases that even the top competitors could not predict correctly. A medical committee of several expert pathologists looked for possible explanations for these erroneous results by reviewing the images, and we present their findings here targeted for a large audience of pathologists and data scientists in the field of digital pathology.

Pembrolizumab with Capox Bevacizumab in patients with microsatellite stable metastatic colorectal cancer and a high immune infiltrate: The FFCD 1703-POCHI trial.

Pembrolizumab, a PD1 immune checkpoint inhibitor (ICI), was recently reported to be very effective in patients with microsatellite instable/deficient mismatch repair metastatic colorectal cancer (MSI/dMMR mCRC), unlike patients with microsatellite stable/proficient MMR (MSS/pMMR) mCRC, in whom ICIs are generally ineffective. However, about 15% of MSS/pMMR CRCs are highly infiltrated by tumour infiltrating lymphocytes. In addition, both oxaliplatin and bevacizumab have been shown to have immunomodulatory properties that may increase the efficacy of an ICI. We formulated the hypothesis that patients with MSS/pMMR mCRC with a high immune infiltrate can be sensitive to ICI plus oxalipatin and bevacizumab-based chemotherapy. POCHI is a multicenter, open-label, single-arm phase II trial to evaluate efficacy of Pembrolizumab with Capox Bevacizumab as first-line treatment of MSS/pMMR mCRC with a high immune infiltrate for which we plan to enrol 55 patients. Primary endpoint is progression-free survival (PFS) at 10 months, which is expected greater than 50%, but a 70% rate is hoped for. Main secondary objectives are overall survival, secondary resection rate and depth of response. Patients must have been resected of their primary tumour so as to evaluate two different immune scores (Immunoscore® and TuLIS) and are eligible if one score is "high". The first patient was included on April 20, 2021.

Artificial intelligence for solid tumour diagnosis in digital pathology.

Tumour diagnosis relies on the visual examination of histological slides by pathologists through a microscope eyepiece. Digital pathology, the digitalization of histological slides at high magnification with slides scanners, has raised the opportunity to extract quantitative information due to image analysis. In the last decade, medical image analysis has made exceptional progress due to the development of artificial intelligence (AI) algorithms. AI has been successfully used in the field of medical imaging and more recently in digital pathology. The feasibility and usefulness of AI assisted pathology tasks have been demonstrated in the very last years and we can expect those developments to be applied to routine histopathology in the future. In this review, we will describe and illustrate this technique and present the most recent applications in the field of tumour histopathology. LINKED ARTICLES: This article is part of a themed issue on Molecular imaging - visual themed issue. To view the other articles in this section visit http://onlinelibrary.wiley.com/doi/10.1111/bph.v178.21/issuetoc.

Mitosis detection in breast cancer histological images An ICPR 2012 contest.

INTRODUCTION: In the framework of the Cognitive Microscope (MICO) project, we have set up a contest about mitosis detection in images of H and E stained slides of breast cancer for the conference ICPR 2012. Mitotic count is an important parameter for the prognosis of breast cancer. However, mitosis detection in digital histopathology is a challenging problem that needs a deeper study. Indeed, mitosis detection is difficult because mitosis are small objects with a large variety of shapes, and they can thus be easily confused with some other objects or artefacts present in the image. We added a further dimension to the contest by using two different slide scanners having different resolutions and producing red-green-blue (RGB) images, and a multi-spectral microscope producing images in 10 different spectral bands and 17 layers Z-stack. 17 teams participated in the study and the best team achieved a recall rate of 0.7 and precision of 0.89. CONTEXT: Several studies on automatic tools to process digitized slides have been reported focusing mainly on nuclei or tubule detection. Mitosis detection is a challenging problem that has not yet been addressed well in the literature. AIMS: Mitotic count is an important parameter in breast cancer grading as it gives an evaluation of the aggressiveness of the tumor. However, consistency, reproducibility and agreement on mitotic count for the same slide can vary largely among pathologists. An automatic tool for this task may help for reaching a better consistency, and at the same time reducing the burden of this demanding task for the pathologists. SUBJECTS AND METHODS: Professor Frιdιrique Capron team of the pathology department at Pitiι-Salpκtriθre Hospital in Paris, France, has selected a set of five slides of breast cancer. The slides are stained with H and E. They have been scanned by three different equipments: Aperio ScanScope XT slide scanner, Hamamatsu NanoZoomer 2.0-HT slide scanner and 10 bands multispectral microscope. The data set is made up of 50 high power fields (HPF) coming from 5 different slides scanned at ×40 magnification. There are 10 HPFs/slide. The pathologist has annotated all the mitotic cells manually. A HPF has a size of 512 µm × 512 µm (that is an area of 0.262 mm (2) , which is a surface equivalent to that of a microscope field diameter of 0.58 mm. These 50 HPFs contain a total of 326 mitotic cells on images of both scanners, and 322 mitotic cells on the multispectral microscope. RESULTS: Up to 129 teams have registered to the contest. However, only 17 teams submitted their detection of mitotic cells. The performance of the best team is very promising, with F-measure as high as 0.78. However, the database we provided is by far too small for a good assessment of reliability and robustness of the proposed algorithms. CONCLUSIONS: Mitotic count is an important criterion in the grading of many types of cancers, however, very little research has been made on automatic mitotic cell detection, mainly because of a lack of available data. A main objective of this contest was to propose a database of mitotic cells on digitized breast cancer histopathology slides to initiate works on automated mitotic cell detection. In the future, we would like to extend this database to have much more images from different patients and also for different types of cancers. In addition, mitotic cells should be annotated by several pathologists to reflect the partial agreement among them.

Time-efficient sparse analysis of histopathological whole slide images.

Histopathological examination is a powerful standard for the prognosis of critical diseases. But, despite significant advances in high-speed and high-resolution scanning devices or in virtual exploration capabilities, the clinical analysis of whole slide images (WSI) largely remains the work of human experts. We propose an innovative platform in which multi-scale computer vision algorithms perform fast analysis of a histopathological WSI. It relies on application-driven for high-resolution and generic for low-resolution image analysis algorithms embedded in a multi-scale framework to rapidly identify the high power fields of interest used by the pathologist to assess a global grading. GPU technologies as well speed up the global time-efficiency of the system. Sparse coding and dynamic sampling constitute the keystone of our approach. These methods are implemented within a computer-aided breast biopsy analysis application based on histopathology images and designed in collaboration with a pathology department. The current ground truth slides correspond to about 36,000 high magnification (40×) high power fields. The processing time to achieve automatic WSI analysis is on a par with the pathologist's performance (about ten minutes a WSI), which constitutes by itself a major contribution of the proposed methodology.

A cognitive virtual microscopic framework for knowledge-based exploration of large microscopic images in breast cancer histopathology.

Histopathological examination is a powerful method for prognosis of major diseases such as breast cancer. Analysis of medical images largely remains the work of human experts. Current virtual microscope systems are mainly an emulation of real microscopes with annotation and some image analysis capabilities. However, the lack of effective knowledge management prevents such systems from being computer-aided prognosis platforms. The cognitive virtual microscopic framework, through an extended modeling and use of medical knowledge, has the capacity to analyse histopathological images and to perform grading of breast cancer, providing pathologists with a robust and traceable second opinion.

An automatic system for the analysis of intercellular communication and early carcinogenesis.

Some recent works on intercellular communication pointed out an impaired trafficking of Cx43 proteins in early carcinogenesis. In collaboration with biologists, we propose an automatic system for the analysis of spatial protein configurations within cells at early tumor stages. This system is an essential step towards the future development of a computer-aided diagnosis tool and the statistical validation of biological hypotheses about Cx43 expressions and configurations during tumorogenesis. The proposed system contains two dependent part: a segmentation part in which the cell structures of interest are automatically located on images and a characterization part in which some spatial features are computed for the classification of cells. Using immunofluorescent images of cells, the nucleus, cytoplasm and proteins structures within the cell are extracted. Then, some spatial features are computed to characterize spatial configurations of the proteins with regard to the nucleus and cytoplasm areas in the image. Last, the 3D cell images are classified into pathogenic or viable classes. The system has been quantitatively evaluated over 60 cell images acquired by a deconvolution high-resolution microscope and whose ground truth has been manually given by a biologist expert. As a perspective, a 3D spatial reasoning and visualization module is currently under development.